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THE HOWE DUALITY CONJECTURE: 
QUATERNIONIC CASE 


WEE TECK GAN AND BINYONG SUN 
In celebration of 

Professor Roger Howe’s 70th birthday 


Abstract. We complete the proof of the Howe duality conjecture in the theory of local theta 
correspondence by treating the remaining case of quaternionic dual pairs in arbitrary residual char¬ 
acteristic. 


1. Introduction 

Let F be a non-archimedean local field of characteristic not 2. Let W be a finite-dimensional 
symplectic vector space over F with symplectic form {, )w- Write 

(1.1) 1 ^ {1, ew} Sp(lF) Sp(lF) 1 

for the metaplectic double cover of the symplectic group Sp(lF). It does not split unless W = Q. 
Denote by H(IF) := IF x F the Heisenberg group attached to IF, with group multiplication 

(u, a)(w, P) := {u + v,a + (3+ {u, v)w), u,v €W, a, /3 G F. 

Then Sp(IF) acts on H(IF) as group automorphisms through the action of Sp(IF) on IF, and we may 
form the semi-direct product J(IF) := Sp(IF) x H(IF). 

Fix an arbitrary non-trivial unitary character "0 : F —> C^. Up to isomorphism, there is a unique 
smooth representation of J(IF) (called a Weil representation) such that (c/. [Wei Section IV.43]) 

• Wj/’Ih(w) is irreducible and has central character 

• ew & Sp(IF) acts through the scalar multiplication by —1. 

Unless IF = 0, the above second condition is a consequence of the first one. 

Denote by r the involution of EndF(IF) specified by 

{x ■ u, v)w = (m, x'^ ■ v)w, M, u G IF, cc G EndF(IF). 

Let {A, A') be a pair of r-stable semisimple F-subalgebras of EndF(IF) which are mutual centralizers 
of each other. Put G := A n Sp(IF) and G' := A' n Sp(IF), which are closed subgroups of Sp(IF). 
Following Howe, we call the pair (G, G') so obtained a reductive dual pair in Sp(IF). We say that the 
pair {A, A') (or the reductive dual pair (G, G')) is irreducible of type I if A (or equivalently A') is a 
simple algebra, and say that it is irreducible of type H if A (or equivalently A') is the product of two 
simple algebras which are exchanged by r. A complete classification of such dual pairs has been given 
by Howe. 
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For every closed subgroup H of Sp(fF), write H for the double cover of H induces by the metaplectic 
cover dm. Then G and G' commute with each other inside the group Sp(lT) (c/. |MVWl Chapter 
2, Lemma II.5]). Thus, the Weil representation uj^ can be regarded as a representation of G x G'. 

For every tt € Irr(G), put 

0^(7r) := (g) 

to be viewed as a smooth representation of G'. Here and as usual, a superscript indicates the 
contragredient representation, a subscript group indicates the coinvariant space, and “Irr” indicates 
the set of isomorphism classes of irreducible admissible representations of the group. It was proved 
by Kudla m that the representation is admissible and has finite length. Denote by the 

maximal semisimple quotient of 0^(7r), which is called the theta lift of tt. In this paper, we complete 
the proof of the following Howe duality conjecture. 

The Howe Duality Conjecture 

For every reductive dual pair (G, G') and every tt G Irr(G), the theta lift 9^{tt) is irreducible if it is 
non-zero. 

The Howe duality conjecture is easily reduced to the case when the pair {A, A') is irreducible (of 
type I or H). It has been proved by Waldspurger [Wa] when the residual characteristic of F is not 2. 
For irreducible reductive dual pairs of type H, the conjecture was proved in full and more simply by 
Minguez in [^. Every irreducible reductive dual pair of type I is an orthogonal-symplectic dual pair, 
a unitary dual pair, or a quaternionic dual pair [Hll Section 5]. For orthogonal-symplectic dual pairs 
and unitary dual pairs, the conjecture was proved in |GT] (it was earlier proved in |LSTi] that 0^(7r) is 
multiplicity free). For the remaining case of quaternionic dual pairs, only a partial result was obtained 
in m (for Hermitian representations). The reason is that m makes use of the MVW-involution 
on the category of smooth representations, and it has been shown in |LSTa] that such an involution 
does not exist in the quaternionic case. 

The purpose of this paper is to explain how the use of the MVW-involution can be avoided, thus 
completing the proof of the Howe duality conjecture in the quaternionic case. The lack of an MVW- 
involution necessitates relating the theta lifts of tt and , and the key new ingredient is provided by 
the following consequence of the conservation relations shown in [SZ[ Equalities (12)]. 

Lemma 1.1. Assume that (G, G') is irreducible. Then for every tt G Irr(G), 

(1.2) 0^(7r) 7 ^ 0 if and only if 9 ^{tt'^) ^ 0, 
where ij} denotes the complex conjugation of f). 

In proving the Howe duality conjecture, one needs to strengthen Lemma ll.ll to the identity 

(1.3) {9^{tt)Y ^ 0^(7r^) for every tt G Irr(G). 

Hence, the main result of this paper is the following theorem, which encompasses the Howe duality 
conjecture and the identity (11.31) . 

Theorem 1.2. Assume that (G, G') is irreducible, and the size of G is no smaller than that of G'. 
Then for all tt, u G Irr(G), 

• (tt) is irreducible if it is non-zero; 

• 'if — 9.,j,[a) 7 ^ 0, then tt = a; 

. (0v,(^))^=0v)(^U- 

Consequently, the Howe duality conjecture holds for both (G, G') and (G',G), and for every tt' G 

Irr(G'), {9^{tt')Y ^9^{tt’'^). 
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Here the size of G is defined to be 


size(G) 


^ Q!^ jg orthogonal-symplectic or quaternionic dual pair; 

UAi otherwise, 


where K denotes the center of A, A'^~ ^ := {a € A \ = —a}, and ua denotes the integer such 

that rankifH = n\. The size of G' is analogously defined. 


In fact, exploiting Lemma |l. 11 Theorem 11.21 is equivalent to the following proposition. 


Proposition 1.3. Assume that {G,G') is irreducible, and the size of G is no smaller than that of G'. 
Then for all Tr,a G Irr(G), 

(1.4) dim Homg, (0^ (tt) ® (cr), C) < dim Homg (tt ® cr, C). 


In what follows, we show that Lemma 1 1.1 1 and Proposition II.31 imply Theorem 1 1.21 
Proof of (Lemma 11.11 + Proposition 11.31 =>- Theorem II. 2p 

For every tt G Irr(G) and tt' G Irr(G'), write 

m^(7r, tt') := dimHomg^g,(a;^, tt KI tt') 
and dehne m. 0 ( 7 r, 7 r') similarly. We claim that 

(1.5) m^( 7 r, tt') 7 ^ 0 if and only if m^( 7 r^, tt'^) 7 ^ 0. 

It is easy to see that (El and (11.51) imply Theorem 1 1.2 1 

To prove the claim, we first assume that m^( 7 r, 7 r') 7 ^ 0. Applying Lemma ri.il to the pair (G',G), 
we see that m^(cr, tt'^) 7 ^ 0 for some a G Irr(G). The inequality (11.411 then implies that a = and 
hence m^( 7 r'^, tt'^) 7 ^ 0. Similarly, if m,^( 7 r^,CT^) 7 ^ 0 then m^( 7 r, tr) 7 ^ 0. This proves the claim p.5|) . 
and therefore shows that Lemma o and Proposition II.31 imply Theorem 11.21 


In view of the above, the main body of our paper will be devoted to the proof of Proposition 11.31 

Remarks: (a) Reductive dual pairs as defined in this paper include the following case: G is the 
quaternionic orthogonal group attached to a one-dimensional quaternionic skew Hermitian space, and 
G' is the quaternionic symplectic group attached to a non-zero quaternionic Hermitian space (see the 
next section). In this case, G' is strictly contained in the centralizer of G in the symplectic group. 

(b) Although in the statements of [Yal Theorems 1.3 and 1.4] (see Lemma [221) [SZl Equalities 

(12)], the authors assume that the base field F has characteristic zero, their methods prove the same 
results for all non-archimedean local field F of characteristic not 2. 

(c) For type H irreducible reductive dual pairs, the identity (11.31) is a consequence of [Ml Theorem 1], 
in which the explicit theta lifts are determined in terms of the Langlands parameters. For orthogonal- 
symplectic and unitary dual pairs, ESI is a consequence of the MVW involution (cf. [Si Theorem 
1.4]). 
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2. The doubling method 


We will only treat the quaternionic case in the proof of Proposition ll.31 since it is previously known 
in all other cases. Let F be a nonarchimedean local field of characteristic not 2, with | • |f denoting 
the normalized absolute value on F. Let D be a central division quaternion algebra over F, which is 
unique up to isomorphism. Denote by t : D —>■ D the quaternion conjugation of D. We consider an 
e-Hermitian right D-vector space t/, and an e'-Hermitian left D-vector space F, where e = ±1 and 
e' = —e. To be precise, 17 is a finite dimensional right D-vector space, equipped with a non-degenerate 
F-bilinear map 

(,)[/: 17 X 17 ^ D 

satisfying 

{u,u'a)u = {u,u')u a and {u,u')ij = ,u)\j, u,u'GU,a€D. 

Similarly, F is a finite dimensional left D-vector space and is equipped with a form (, )v : F x F —^ D 
with the analogous properties. The tensor product W := U Gd F is a symplectic space over F under 
the bilinear form 


( 2 . 1 ) 


{u (g) -u, m' ® v')w 


(m, u')u {v, v'Yy + {v, v')v {u, u% 
2 


u, u G 17, V, v' £ F. 


Throughout the paper, we fix two quadratic (order at most 2) characters xu,Xv ■ t {±1} 
determined by the discriminants of U and V respectively. More precisely, we have: 


( dimV \ 

(-Ij'i™^ n (e.,e.)v{e.,e.)(„a , uGF", 

i=l / F 

where ei, 62 , • • • , edim v is an orthogonal basis of F, and (, )f denotes the quadratic Hilbert symbol 
for F. Likewise, one has the analogous definition for xu- Note that if e = 1, then the isometry class 
of U is determined by its dimension, and xu only depends on the parity of dim!/; likewise, if e' = 1, 
Xv only depends on the parity of dim F. 

Denote by W~ the space IF equipped with the form scaled by —1. Write IF'^ := IF © 1F“ for 
the orthogonal direct sum, which contains := {{u,u) G IF'^ | u G IF} as a Lagrangian subspace. 
Define 17“, F“, 17'^, F'^, 17^, similarly. Then we have obvious identifications of symplectic spaces 

1F“ = 17“ ©D F = 17 ©D F“ and 1F° = 17° ®d F = 17 ©d F°. 


Let G(17) denote the isometry group of 17, and similarly for other groups. Then we have identifications 


G(17)=G(17“) and G(F) = G(F“), 
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and inclusions 

G(C7) X G(C7-) C G(C/°) and G(y) x G(V-) C G(y°). 

Denote by P(17^) the parabolic subgroup of G(C/'^) stabilizing U^. Likewise, denote by P(td^) the 
parabolic subgroup of G(D'^) stabilizing V^. 

Let w and uj~ be irreducible admissible smooth representations of H(bP) and H(VP“), respectively, 
both with central character tp. Then the representation := w a;“ of H(1T) x H(1T“) descends 
to a representation of H(1T'^) through the surjective homomorphism 

R{W) X H(fT-) ^ H(fP°), ((r, a), {v, /3)) ^ ((w, v), a + p). 

This representation of H(TT'^) uniquely extends to the group G{U^) x H(VP'^) such that (c/. |SZ1 
Theorem 4.7]) 

(2.2) Aa( 5 • ^) = Xu(det(g|,yA)) |det(5r|[;A)||™'^ Aa((/'), ^ e g g P({7^), 

where Aa denotes the unique (up to scalar multiplication) non-zero VP'^-invariant linear functional 
on and det denotes the reduced norm. Similarly, this representation of H(VP^) uniquely extends 
to the group G(y'^) x H(VP°) such that 

Aa(5'• 0) = X(7(det(5'|y*)) |det(gV^)lF™^ Aa)!)-), 5'G P(D^). 

We extend the representation w to {G{U) x G(D)) x H(IT) and extend the representation oj~ to 
(G(17“) X G{V~)) X H(VP“) such that 

((5.5') • <(') ® {{h,h') ■ (j)~) = gh- {g'h' ■ {(p (g, (j)~)) = g'h' ■ {gh ■ {(p (g, (j)~)), 

for all ig,h) G G{U) x G(17“), {g',h') G G(D) x G(G“), cp € uj and (p~ G oj~. Then u and oj~ are 
contragredient to each other with respect to the isomorphism 

(G(;7) X G(D)) X H(W) ^ (G(C/-) x G(l/-)) x H(W-), ((5,5'), K^)) ^ {{g,g').{u,-a)). 

If necessary, we also write wuy,ip for the representation u of {G{U) x G(y)) x H(VP), and write 

for the representation uj~ of {G{U~) x G(D“)) x H(VP“), to emphasize their dependence on U, V and 

ip. 

Thus, we have defined a splitting of (the pushout via {±1} of) the metaplectic cover G{U) 

and G{V) over G(17) and G{V) respectively, so that the Weil representation uJuyy is a representation 
of the linear group G{U) x G(D). Such a splitting is unique over G{U) if U is quaternionic-Hermitian 
of dimension > 1, but is not unique if U is quaternionic-skew-Hermitian (as one can twist by quadratic 
characters of G{U)). For the purpose of formulating and proving the Howe duality conjecture, there 
is no loss of generality in working with a fixed splitting. 

More precisely, as in the introduction, for every tt G Irr(G(17)), put 

0^(71) := (w®7r'^)G(u), 

and define the theta lift 0uj{tt) to be the maximal semisimple quotient of 0aj(T). Similarly, the theta lift 
is defined for all tt' G Irr(G(tA)). The theta lifts with respect to other oscillator representations, 
such as 9^-, are analogously defined. 

Put 

suy '■= ^dimG + “ ^dimP -f and sv,u '■= ^dimP -|- — ^dimt/ + ^ = —Suy- 

The following is a reformulation of Proposition 11.31 in the quaternionic case, using the notations 
introduced above. 
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Proposition 2.1. If su,v > 0, then for all TT,a € Irr(G(?7)), 

(2.3) dimHomG(y)(0^(7r) (g) 0^-(cr),C) < dimHomG([/) (tt (g> cr, C). 

The linear functional Aa of (I2.2|l induces a G(17'^)-intertwining linear map 

(2.4) i(sv,(7), 4>{g■ 4>))- 

Here for each s S C, 

I(s) := Indp[^A) ixv Idetj/Al^), 

where det^A : GL(17^) —>■ denotes the reduced norm map, and xv is viewed as a character of 

GL(C/^) via the pullback through this map. Throughout this paper, Ind will denote the normalised 
parabolic induction functor. 

Denote by G(F)^ the group G(F) diagonally embedded in G(F) x G(F“), to be viewed as a 
subgroup of G(F°). 

Lemma 2.2. The linear map (EH) induces a G(U^)-intertwining linear embedding 

(w°)g(U)A I(su,C/)- 

If su,v > 0, then there exists a surjective G{U^)-intertwining linear map 

I(sc/.u) ^ (‘^°)g(V)A C I{sv,u)- 

Proof. The first assertion is due to Rallis, see m Theorem II. 1.1] and [MVWl Chapter 3, Theorem 
IV.7]. The second one is proved in |Yal Theorems 1.3 and 1.4]. □ 

Write qu for the Witt index of U. Fix two sequences 

(2.5) 0 = Vo C Vi C • • ■ C and X*^ D ■ ■ ■ D X* D X* = 0 

of totally isotropic subspaces of U such that for all t = 0,1, • • • ,qu, 

{ dimVt = dimV(* = t; 

Xt n Xf = 0; and 

Xt © Xf is non-degenerate. 

Denote by Ut the orthogonal complement of Xt © in U. Write P(Vt) and P(V(*) for the parabolic 
subgroups of G{U) stabilizing Xt and Xf, respectively. Then 

P{Xt)GP{X*t) = GUXt)^G{Ut) 

is a common Levi factor of P(Vt) and P(V(*). 

We need the following lemma (see [KRI Section 1]). 

Lemma 2.3. Let s € C. As a representation ofG{U) xG{U~), I(s) possesses an equivariant filtration 

0 = /_i(s) C Io{s) C /i(s) C • • • C V(s) = I(s) 

with successive quotients 

Rt{s) = It{s)/It-iis) = ((xu|detxJ^+‘ ^ Xu|detxJ^+‘) © (G(C/t))) , 

where 0 <t < qu, and 

• detxt : GL(Vt) —>■ F^ denotes the reduced norm map, and xv is viewed as a character of 
GL(Vt) via the pullback through this map; 

• G{Ut) X G{Ut) acts on C^{G{Ut)) by left-right translation. 

In particular, Rq{s) = G“(G(C/)) is the regular representation. 
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In view of Lemma 12.31 we make the following definition. 

Definition : We say that an irreducible admissible smooth representation ttKIct of G{U) x G{U~) lies 
on the boundary of I(s) if 

HomG((7)xG(u-)(-Rt(s)>7^ ^ cr) ^ 0 for some 0 < < < 
where Rtis) is as in Lemma 12.31 
Now we have: 


Proposition 2.4. Provosition \2.1\ holds when tt cr does not lie on the boundary ofl{su,v)- 
Proof. Consider the doubling see-saw 

G(C/°) G(P) X G(P-) 



G(C/)xG(C7-) G(P)^. 

Given tt, cr e Irr(G(?7)), the see-saw identity gives 

(2.7) HomG((7)xG(u-)((w°)G(u)-^,7rKI(T) = HomG(v)(6><^(7r) 0 0<^-(cr),C). 

Assume that suy > 0 and irMa does not lie on the boundary of I(s( 7 _v), then we have 
HomG(y)( 0 ^( 77 ) (8> 6»^-(cr),C) 

^ HomG(y)(6><^(7r) (8)6>^-(cr),C) 

= HomG((7)xG(u-)((‘^°)G(y)^)7r cr) 

^ HomG((7)xG(u-)(I(sc/,u),7r K tj) (by Lemma [121) 

-4 HomG(;7)xG(;7-)(C'r(G(G)),7rKI(T) (by Lemma 221) 

= HomG(u) (tt <8) cr, C) . 

This proves the proposition. □ 


3. Some induced representations 

To complete the proof of ProDOsition l2.ll we need to consider representations ttKIct of G{U)xG{U~) 
which lie on the boundary of I(sf 7 ,v)- To deal with these, we study in this section some parabolically 
induced representations which will play an important role later on. 

For smooth representations p of GL(At) and tr of G{Ut) {0 < t < qu), we write 

p X cr := Indp^^^^^p 8 a. 

More generally, the parabolic subgroup P of G(17) stabilizing a flag 
(3.1) 0 = C W, C W, C • • • C Xt^ 

has a Levi factor of the form GL(Xjj) x GL(Xt 2 /Xt^) x • • ■ x Glj{Xt^/Xt^_f) x G{Ut^). We set 

Pi X ■ • • X Pa XI cr := Indp^*^^ Pl 8 • • • 8 Pa 8 cr, 

where pi is a smooth representation of GL(At./Xi^_j) and cr is a smooth representation of G{Ut^). 
Similarly, for the general linear group GL(Xi^), we set 

OT (X "I 

Pi X ■ • • X Pa := Indg *“ Vi ® ''' 8 Pa, 
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where Q is the parabolic subgroup of GL(Xt^) stabilizing the flag (13.111 . Respectively write RjCt and 
Rx; for the normalized Jacquet functors attached to P(-^t) and P(X(*). 

Let r] be a character of F^. Then 77^“ (0 < a < gy) is an irreducible representation 

of GL(Xo) {cf. [Se]). Here 77 is viewed as a character of Glj{Xt/Xt-i) (1 < t < a) via the pullback 
through the reduced norm map Glj{Xt/Xt-i) F^. For every tt € Irr(G(17)), define 

(3.2) in,,(7r) := max{0 < a < qu \ tt ^ 77^“ x a for some cr S Irr(G(17Q))}. 

Here tt ^ 77^“ x cr means that there is an injective homomorphism from tt to 77^“ x a (similar notation 
will be used without further explanation). 

The rest of this section is devoted to a proof of the following proposition. 

Proposition 3.1. Assume that rf is non-trivial. Then for every tt G Irr(G([/)), there is a unique 
representation tt^ G Irr(G(Ua)) such that tt 77^“ x tt^, where a := m^(7r). Moreover, 

r TTrf ^ (Rx„(7r) 0 (??"^)''“)gl(a,) - HomGL(xj((b"^)''“,R-A*(7r)); 

I TT is isomorphic to the socle 0/77^“ x tt^; 

I m^(7r) = m^(7r^); 

I (ttV), - (^,)V. 

We begin with the following lemma. 

Lemma 3.2. For all p G Irr(GL(Xa)) (0 < a < qu) which is not isomorphic to 77^“, 

ExtGL(xj(^''“.P) = 0 (iGZ). 

Proof. Since the Jacquet functor is exact and maps injective representations to injective representa¬ 
tions, the second adjointness theorem of Bernstein implies that 

(3.4) ExPgl(x.)(^^“,p) = Ext|DX).(77^“,R(p)). 

Here GL(Jfa) is identified with GLq(D) as usual, and R denotes the normalized Jacquet functor 
attached to the minimal parabolic subgroup of GLq(D) of lower triangular matrices. Note that 
p ^ 77^“ implies that 77®“ is not a subquotient of R(p) {cf. [Bel Chapter 3, Section 2.1, Theorem 18]). 
Then it is easy to see that the right hand side of (13.41) vanishes. 

□ 

By an easy homological algebra argument. Lemma 13.21 implies the following lemma. 

Lemma 3.3. For all p G lrr(GL(Jfa)) (0 < a < qjj) which is not isomorphic to 77^“, and all 
a,a' GlTi{G{Ua)), 

ExtGL(Xa)xG(;7a)(^^'* Kl (T,P K cr') = 0 {i G Z). 

From now on, we assume that the character 77^ 1. 

Lemma 3.4. Let a G Irr(G(t/a)) (0 < a < qu). Assume that m^(cr) = 0 (as defined in (|3.2p ). Then 

(??^“ X cr) = (77^“ K cr) © p, 

where p is a smooth representation of GL(Xa) x G{Ua) which has no irreducible subquotient of the 
form 77^“ Kl cr' with a' G Irr(G(f7a)). Consequently, the socle of x cr zs irreducible. 

Proof. Denote by p the kernel of the natural surjective homomorphism 

(3.5) Rx„(r?^“ X 0-) ^77^“Kcr. 

As in the proof of [GTl Lemma 5.2], using an explication of the Geometric Lemma of Bernstein- 
Zelevinsky {cf. [n Lemma 5.1] and [Ha ] ). the assumption of the lemma implies that p contains no 
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irreducible subquotient of the form 77 ^“ Kl a' with a' G Irr(G(C/a)). Then Lemma [3.31 implies that 
the surjective homomorphism (|3.5|) splits. This proves the first assertion of the lemma. The second 
assertion then easily follows as in [GTl Lemma 5.2]. □ 

In the rest of this section, let tt G Irr(G(C/)) and put a := m^( 7 r). Then there is an irreducible 
representation cr G Irr(G(t/a)) such that tt ^ 77 ^“ xi a. Induction-by-steps shows that m^((T) = 0. 

Lemma 3.5. One has that 

R-A:„(7r) = (?7^“ KIcr) ©p, 

where p is a smooth representation of GL(Xa) x G(17o) whieh has no irreducible subquotient of the 
form 77 ^“ Kl a' with a' G Irr(G(C/a)). 

Proof. Since Rx„ (tt) is a subrepresentation of Rx„ (77 ^ “ x cr) and has 77 ^ “ Kl cr as an irreducible quotient, 
the lemma easily follows from Lemma 13.41 □ 

Lemma 3.6. One has that 

Rx*( 7 r) = (( 77 “^)^“ K cr) ©p, 

where p is a smooth representation of GL(Xa) x G(C/a) which has no irreducible subquotient of the 
form ( 77 “^)^“ Kl cr' with a' G Irr(G(C/a)). 

Proof. Note that P(Xa) is conjugate to P(-^a) by an element w G G(t7) such that w is the identity 
on Ua and w exchanges Xa and X*. Via conjugation by w, we see that Lemma [3.61 is equivalent to 
Lemma 13.51 

□ 


Lemma 13.51 and Lemma 13.61 imply that 

= (RY„(7r) © iv~^V)GL{x^) - HomGL(x©((??“^)''“,Rx;(7r)). 

This proves the uniqueness assertion of Proposition l3Tl as well as the first assertion of (IT^ . The 
second assertion of (13.311 is then implied by the last assertion of Lemma 13.41 

Lemma 3.7. One has that 


Proof. Lemma l3.61 implies that 

(^-l)Xa ^ ^ ^ Rx*(7r). 

By dualizing and using the second adjointness theorem, we see that 

This implies that 77 ^^“ x cr'^. 


□ 


Lemma 13.71 implies that m^( 7 r'') > m,j( 7 r). The same argument shows that m^( 7 r) > m^( 7 r'^). This 
proves that m^( 7 r^) = m^( 7 r). Lemma 13.71 then further implies that (rr^)^ = (tt,,)''. This finally 
finishes the proof of Proposition 13.II 
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4. Induced representations and theta correspondence 


In this section, we apply the results of the previous section to the theta correspondence. Write 
77 ' : —?> for the character such that 

v' ■ XV =V Xu- 

Then {rj'Y ^ 1 since if' 7 ^ 1. Denote by qv the Witt index of V. Similarly to (I2.5I1 . we fix two 
sequences 

0 = Vo CYi C ■■■ CVgy and Y* D Y* = 0 

of totally isotropic subspaces of V with the analogous properties as in p.5ll . We apply the analogous 
notation as in the last section to the space V. In particular, m^/( 7 r') is defined for every tt' G Irr(G(F)). 
Define (tt G Irr(G(17)) and n'^, as in Proposition l3.ll 

For all integers 0 < a < qu and 0 < k < qv, write uJa,k ■= wc/a.Vfc.V’i which is an irreducible smooth 
representation of {G{Ua) x G(V/c)) x H(17a < 8 )d 14), as defined in Section^ 

The rest of this section is devoted to a proof of the following key proposition. 


|SC7,V + 1 

If 


Proposition 4.1. Assume that 

r] ^ Xv\and -q'^ xuV 
Then for all tt G Irr(G(17)) and tt' G Irr(G(F)) such that HomG(( 7 )xG(u)(<^!'^ ^ '^0 ¥" 0; ane has 

m,,(7r) = m^/(7r'). 


and there is a linear embedding 

HomG(c/)xG(y)(w,7rKl7r') -A HomG(c/„)xG(UD(wa.a, ^ tt),,), 

where a := m^(7r). 


For each right D-vector space X, write X' for the left D-vector which equals X as an abelian group 
and whose scalar multiplication is given by 

av := va', a G D, w G X'. 

We first recall the well-known computation of the Jacquet module of the Weil representation (see [K1 
Theorem 2.8] and |MVW[ Chapter 3, Section IV.5]). 


Lemma 4.2. For each 0 < a < qu, the normalized Jacquet module Rx„(w) has a GL(Vo) x G{Ua) x 
G{V)-equivariant filtration 

Rx„ (w) = i?o D D • • • D i?a' D i?a'+l = 0 


whose successive quotient is 


Jk := Rk/Rk+T = (xu|detx„_ 


i-sv U'\'0,—k 

If ' 


iCr(Isom(V‘/V‘_„n))®^a.fc) 


where 


• a' := min{a, qy} and 0 < fc < a'; 

• Y(Xa-k,Xa) is the parabolic subgroup of G1 j(X a) stabilizing Xa-ki 

• detx„_fe : GL(Va_/c) —)• F^ denotes the reduced norm map, and xv is viewed as a character 
of GL{Xa-k) via the pullback through this map; 

• Isom(V‘/X^_j,, Yfc) is the set of H-linear isomorphisms from X'^/X''^_f. toYk, andGT[Xal Xa-k) 
GL(yfc) acts o?z G“(Isom(X^/V^_^,,yfc)) as 

iib,c) ■ f){g) = xv(det6)x[/(detc)/(c"^g&), 


for lb, c) G Gh{Xa/Xa-k)^Gh{Yk), f G G“(Isom(X^/V‘_^,, Yfc)) andg G Isom(X‘/V‘_j,, Y^). 
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In particular, if a' = a, then the bottom piece of the filtration is 

ja - r,)) ® wa,a ). 

The following lemma is an observation of [GTj . 


Lemma 4.3. Let a, k and Jh he as in Lemma U-^l Assume that r? ^ Xv \ ■ ■ Then for all 

a e Irr(G(C/a)) and tt' G Irr(G(G)), 


(4-1) HomGL(A„)xG(f7„)xG(U)('^fcj (T Kl tt') = 0 

whenever k ^ a. 


Proof. Using the second adjointness theorem, it suffices to show that 

HomGL(x„_^,)(xu|detx„_fc|^’''’^“”^i4x„_;,.x„ (??''“)) = 0, 

where Rx„_fc,Xa denotes the normalized Jacquet functor attached to the parabolic subgroup of GL(Xa) 
stabilizing a complement of Xa-k in Xa- By analysing the cuspidal data, we know that every irre¬ 
ducible subrepresentation of R.Xa_fc,A:„is isomorphic to Kl 77 ^^, as a representation of 

GL(Xa_fe) X GL{Xa/Xa-k)- Therefore the lemma follows. □ 


Now we come to the proof of Proposition 14.II Put a := m^(7r). Then we have 

0 ^ HomG(u)xG(u)(w,7rKl7r') 

-A HomG(;7)xG(U)(w,(7?^“ xi7r^)Kl7r') 

= HomGL(Xa)xG(f7a)xG(U)(R.Xa (w), Kl TT^ Kl Tt') 

-A HomGL(x„)xG(uUxG(u)(-^a,77^“^7r^^7r') (by Lemma HSl) 

= HomGL(Xa)xG(f7„)xGL(Ya)xG(Ua)(C'“(IsOm(X‘, Fo)) G UJa,a,V^^ M TT^j Ry. (tt')) 

(by the second ajointness theorem) 

— HomG(c/„)xGL(Ya)xG(Va)((^^ ) ^ Wo,o, Tj; ^ Ry^* (tt')) 

^ HomG(;7a)xG(Uu(wa.a,7r^ 


where 

< := HomGL(Yj((??'”^)''“,RY„*(7r'))- 

Therefore ^ 0, and hence 

HomGL(Y„)xG(Ua)((^'”^)''“ ^ 0. 

Dualizing and using the second adjointness theorem, we see that 

HomGL(Ya)xG(l4)(RY„(7r''^),r7'''“ ^ 0. 


This proves that 


m^/(7r') = m^/(7r'^) > a = m^(7r). 

The same argument shows that m^(7r) > m^/(7r'), and hence m^/(7r') = m^(7r). Therefore ir'a 
Proposition 13.II This finishes the proof of Proposition 14.II 


by 
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5. Proof of Proposition [271] 

In this section, we finish the proof of Proposition 12.11 by induction on dim U. As in Proposition 
[O let Tr,a G Irr(G(17)) and assume that su^v > 0. In view of Proposition 12.41 we may assume that 
TT Kl CT lies on the boundary of I(s( 7 ,y). Then there is an integer 0 < t < qu such that 

(5.1) HomG((7)xG(c/-)(-Rt(su.u),7’‘^cr) 7^0. 

Note that 


(5.2) 


dimHomG(v)(6»a;(7r) (g) 6 >^-(ct), C) 

dimHomG([/)xG(u)(w, 7 rKl 7 r') ■ dimHomG(c/)xG(u)(w", cr ^ tt'^^). 


7r'€lrr(G(V)) 


We assume that the value of the above equality is non-zero, as Proposition 12.11 is otherwise trivial. 
Then there is an irreducible representation tt' G Irr(G(P)) such that 

(5.3) HomG(c/)xG(u)(w, 7 rKl 7 r') 7 ^ 0 and HomG(; 7 )xG(y)(w",cr Kl tt'^) ^ 0. 

By the second adjointness theorem, implies that 


(5.4) 

Put 


Horn, 


GL(Xt 


(x|det 


X 


\su,v+t 

t If ’ 


Rx;(7r)) ^0. 


V-=Xv\-r’"-^^+^ and r]' 


Using the second adjointness theorem and the Langlands parameter of the character xvldetx* Ip 
f|5.4[) implies that 


SV,U—t 


Noting that 


m^(7r) = m^(7r^) > 0. 


/ I |Sv,[/ + l 1 f / \ 

VrXvl’lF T] ^ Xu\’\f 


Proposition 133] (and its analog for uj ) then implies that 


m^( 7 r) = m^/( 7 r') = m^/( 7 r' ) = m^(cr). 

By the induction assumption. Proposition 12.11 holds for the pair (Go, 14), where a := m^( 7 r). 
As we have seen at the end of the introduction, this implies that Theorem 11.21 holds for the pair 
(G(Ga), G(t4))- Together with Proposition l4.ll this implies that 


(5.5) 

and 


TT'n> = Qu 


.(tt,,) 


(5.6) and cr^ ^ J( 7 r(,,)''). 

Here a;“o ■= Proposition 14.11 and (15.51) imply that tt' is isomorphic to the socle of 77 '^“ xi 

Therefore, there is a unique tt' G Irr(G(G)) which satisfies (j5.3l) . Then Proposition 14.11 
implies that the value of (15.2p is 1. 

On the other hand, (15.61) and the induction assumption imply that — cr^i, which further implies 
that TT^ = cr by Proposition 13.11 Therefore (12.31) of Proposition 12.11 is an equality. This finishes the 
proof of Proposition 12.II 
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